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We  study  the  problem  of  interdicting  the  arcs  in  a  net¬ 
work  in  order  to  maximize  the  shortest  s-t  path  iength. 
“Interdiction”  is  an  attack  on  an  arc  that  destroys  the  arc 
or  increases  its  effective  length;  there  is  a  iimited  inter¬ 
diction  budget.  We  formuiate  this  biievei,  max-min  prob- 
iem  as  a  mixed-integer  program  (MIP),  which  can  be 
soived  directly,  but  we  develop  more  efficient  decompo¬ 
sition  algorithms.  One  algorithm  enhances  Benders  de¬ 
composition  by  adding  generalized  integer  cutting 
planes,  called  “supervalid  inequalities”  (SVIs),  to  the 
master  problem.  A  second  algorithm  exploits  a  unique 
set-covering  master  problem.  Computational  results 
demonstrate  orders-of-magnitude  improvements  of  the 
decomposition  algorithms  over  direct  solution  of  the 
MIP  and  show  that  SVIs  also  help  solve  the  original  MIP 
faster.  ©  2002  Wiley  Periodicals,  Inc.* 

Keywords:  interdiction;  shortest  paths;  bilevel  program;  Bend¬ 
ers  decomposition 

1.  INTRODUCTION 

Network-interdiction  problems  involve  two  opposing 
forces,  a  leader  and  a  follower,  who  are  engaged  in  a 
warlike  conflict.  The  follower  operates  a  network  in  order  to 
optimize  some  objective  function  such  as  moving  a  supply 
convoy  through  the  network  as  quickly  as  possible  or  max¬ 
imizing  the  amount  of  materiel  transported  through  the 
network.  The  leader  attempts  to  limit  the  follower’ s  achiev¬ 
able  objective  value  by  interdicting  arcs,  for  example,  by 
attacking  arcs  to  destroy  them,  to  slow  travel  over  them,  or 
to  reduce  their  capacity.  This  paper  develops  a  new  model 
and  solution  methods  for  the  problem  of  interdicting  a 
transportation  network  in  order  to  maximize  the  shortest 
path  length  between  two  specified  nodes. 

The  topic  of  network  interdiction  has  received  some 
attention  over  the  years,  initially  with  military  applications. 
For  instance,  McMasters  and  Mustin  [31]  and  Ghare  et  al. 
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[21]  developed  methods  for  interdicting  a  capacitated  sup¬ 
ply  network  to  disrupt  the  movements  of  enemy  troops  and 
materiel.  Models  of  drug  interdiction  have  triggered  further 
research  [41,  45]  as  has  the  need  to  assess  the  vulnerability 
of  information  networks  to  interdiction  [23,  32]. 

The  network-interdiction  problem  that  we  focus  on  is 
Maximizing  the  Shortest  Path  (MXSP).  (See  the  related 
models  of  Fulkerson  and  Harding  [18]  and  Golden  [22].)  In 
this  problem,  a  network  user,  that  is,  the  follower,  wishes  to 
traverse  a  path  of  minimum  length  (or  minimum  time, 
minimum  cost,  etc.)  between  two  specified  nodes,  s  and  f,  in 
a  directed  network.  But,  by  first  attacking  the  network  using 
limited  resources,  an  interdictor,  that  is,  the  leader,  can 
destroy  certain  arcs,  or  increase  their  effective  length,  and 
thereby  increase  the  follower’s  shortest  s-t  path  length. 
MXSP  is  the  interdictor’ s  problem:  subject  to  a  limited 
interdiction  budget,  interdict  arcs  in  a  network  to  maximize 
the  shortest  path  length  between  nodes  s  and  f.  We  assume 
that  if  interdicted  arcs  are  destroyed  the  interdiction  budget 
is  insufficient  to  disconnect  s  from  t,  since,  otherwise,  the 
problem  degenerates  into  a  much  simpler  minimum-cut 
problem. 

In  MXSP,  arc  interdiction  involves  a  binary  decision 
with  a  deterministic  outcome:  Arc  k  is  interdicted  or  it  is 
not,  interdiction  consumes  a  known  quantity  of  interdiction 
resource(s),  and  interdiction  always  increases  the  arc’s  ef¬ 
fective  length  by  a  prespecified,  possibly  infinite  amount. 
The  k-most-vital-arcs  problem  [13,  30]  is  a  special  case  of 
MXSP  in  which  the  interdictor  seeks  to  destroy  exactly  k 
arcs  to  interdict  the  network  most  effectively.  Since  that 
problem  is  NP-complete  [5],  it  follows  that  MXSP  is  NP- 
complete. 

The  A:-most-vital-arcs  problem  has  received  limited  at¬ 
tention  and  we  are  not  aware  of  effective  algorithms  for 
solving  it.  Malik  et  al.  [30]  suggested  a  potentially  useful 
but  theoretically  flawed  algorithm  for  the  problem,  which 
we  discuss  in  Section  4.  Corely  and  Shaw  [13]  investigated 
the  single-most-vital-arc  problem,  but  this  problem  is  a 
simple,  special  case  of  MXSP  which  is  solvable  in  polyno¬ 
mial  time. 

MXSP,  and  our  mathematical-programming  approach  to 
solving  it,  allows  more  generality  than  does  the  /c-most- 
vital-arcs  problem.  We  can  use  general  resource  constraints 
to  model  arcs  that  require  various  amounts  of  resource  to 
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interdict.  Also,  our  methods  can  be  extended  to  model 
multiple  types  of  interdiction  resources,  for  example, 
ground  troops,  aerial  sorties,  and  cruise  missiles,  although 
we  focus  on  models  with  a  single  resource  type.  Our  binary 
interdiction  variables  may  also  be  more  realistic  than  are  the 
continuous  variables  of  Fulkerson  and  Harding  [18]  and 
Golden  [22],  where  the  length  of  an  arc  increases  linearly 
with  the  amount  of  interdiction  resource  applied.  As  evi¬ 
dence,  we  note  that  Whiteman  [43]  incorporated  binary 
interdiction  variables  in  a  network-interdiction  model  for 
planning  aerial  interdiction  sorties  for  the  United  States 
Strategic  Command.  His  model  extends  the  maximum- 
flow-based  integer-programming  models  of  Wood  [45], 
which  are  similar  in  spirit  to  the  current  paper’s  model  for 
MXSP. 

Cormican  et  al.  [15]  and  Israeli  [27]  studied  network- 
interdiction  problems  where  the  success  of  an  attempted 
interdiction  is  uncertain  and/or  some  data  are  uncertain. 
Uncertainty  may  be  important  in  some  instances,  but  is 
beyond  the  scope  of  this  paper. 

MXSP  may  be  viewed  as  a  bilevel  mixed-integer  pro¬ 
gram  (BLMIP)  (e.g.,  [9]),  which  is  a  special  case  of  a  static 
Stackelberg  game  [37].  BLMIPs  assume  that  a  leader  first 
chooses  his  actions  and,  subsequently,  a  follower  reacts 
optimally  knowing  those  actions.  (Unlike  BLMIPs,  a  more 
general  Stackelberg  game  may  continue,  alternating  “plays” 
between  the  leader  and  follower.)  However,  the  usual 
BLMIP  does  not  assume  a  max-min  conflict,  as  does 
MXSP.  For  instance,  the  leader  and  follower  might  repre¬ 
sent  two  levels  of  decision  makers  in  a  corporation  and, 
consequently,  would  have  similar  objectives. 

Israeli  [27]  reviewed  existing  algorithms  for  BLMIPs 
and  observes  that  none  is  appropriate  for  solving  MXSP. 
Some  algorithms  [7,  42]  use  a  “positive  approach,”  which 
implies  that  they  function  best  when  there  is  a  strong  pos¬ 
itive  correlation  between  the  leader’s  and  follower’s  objec¬ 
tives.  Such  algorithms  are  likely  to  be  inefficient  with  dia¬ 
metrically  opposed  objectives  as  in  MXSP.  Furthermore, 
computational  experience  is  discouraging:  Bard  and  Moore 
[7]  solved  problems  with,  at  most,  35  binary  variables  for 
the  leader;  Wen  and  Yang  [42]  solved  problems  with,  at 
most,  15  leader  variables;  we  intend  to  solve  problems  with 
over  1000  leader  variables. 

Two  other  techniques  for  solving  BLMIPs  [33,  40]  may 
not  be  inherently  positive,  but  they  rely  on  solving  bilevel 
linear  programs  (BLLPs),  which  are  typically  solved  using 
a  positive  approach.  Moore  and  Bard’s  [33]  algorithm  is 
complicated  and  these  authors  could  not  solve  problems 
with  more  than  10  integer  leader  variables.  Vicente  et  al. 
[40]  only  demonstrated  that  a  BLMIP  can  be  converted  to  a 
BLLP  with  an  unknown  penalty  parameter;  they  reported  no 
computational  results. 

In  fact,  only  three  exact  algorithms  for  BLLPs  have  been 
tested  on  relatively  large  problems  [7,  24,  28]  and  all  used 
a  positive  approach.  A  few  exact  algorithms  [2,  35,  39]  do 
not  use  positive  approaches,  but  none  has  been  tested  on 
large  problems,  and  all  are  complicated  to  implement.  For 


instance,  Anandalingam  and  Apprey  [2]  called  a  subroutine 
to  solve  a  concave  minimization  problem  over  a  polyhedron 
[17].  But  this  minimization  requires  that  the  leader’s  feasi¬ 
ble  region  be  embedded  in  a  simplex,  preferably  a  “tight” 
one,  which  may  not  exist. 

We  conclude  that  no  existing  BLMIP  algorithms  are 
likely  candidates  for  solving  MXSP  effectively.  Further¬ 
more,  the  literature  provides  no  algorithms  in  the  bilevel 
arena  that  take  advantage  of  the  special  max-min  and  short- 
est-path  structure  of  MXSP.  We  must  devise  new  tech¬ 
niques. 

In  this  paper,  we  first  define  MXSP  as  a  max-min  prob¬ 
lem  and  show  how  to  formulate  it  as  a  mixed-integer  pro¬ 
gram  (MIP).  We  would  prefer  to  solve  MXSP  directly 
through  that  MIP  using  simple,  off-the-shelf,  mathematical- 
programming  software.  However,  it  is  intuitively  clear,  and 
later  demonstrated  by  computation,  that  direct  solution  of 
the  MIP  through  linear-programming-based  branch  and 
bound  can  be  extremely  difficult  even  for  modest-sized 
problems.  Therefore,  we  devised  two  decomposition-based 
algorithms  for  MXSP,  along  with  important  enhancements, 
and  demonstrate  their  computational  effectiveness.  Decom¬ 
position  is  a  natural  approach  for  MXSP  because  of  the 
easy-to-solve  shortest-path  subproblems  embedded  in  the 
model. 

Our  first  algorithm  applies  Benders  decomposition  [10] 
to  solve  MXSP,  much  as  Cormican  [14]  solved  a  maximum- 
flow  network-interdiction  problem.  This  basic  algorithm 
performs  poorly,  so  we  develop  a  generalization  of  integer 
cutting  planes  called  “supervalid  inequalities”  (SVIs)  to 
improve  performance.  The  enhanced  algorithm  works  well 
when  delays  caused  by  interdiction  are  modest,  but  the 
algorithm’s  Benders  cuts  are  ineffective  when  delays  are 
large.  A  second  decomposition  algorithm  ameliorates  this 
difficulty  (;)  by  simplifying  the  master  problem  to  a  set¬ 
covering  problem,  (/;)  by  incorporating  a  greedy  heuristic  to 
solve  the  new  master  problem,  in  addition  to  using  an  exact 
algorithm,  and  {Hi)  by  exploiting  the  special  structure  of 
shortest-path  problems  and  suboptimal  solutions  for  the 
follower.  Computational  results  compare  the  efficiency  of 
the  various  solution  techniques  for  MXSP,  including  the  use 
of  SVIs  coupled  with  a  branch-and-bound  solution  of  the 
MIP.  We  end  the  paper  with  conclusions  and  directions  for 
further  research. 

2.  PROBLEM  FORMULATION 

MXSP  is  defined  on  a  directed  graph  G  =  {N,  A),  where 
N  is  the  set  of  nodes,  and  A,  the  set  of  arcs.  The  nominal 
length  of  arc  A:  G  A  is  &  0;  interdiction  increases  the 
arc’s  length  to  where  d^-  >  0.  If  interdiction 

actually  destroys  arc  k,  making  it  impassable,  the  same 
model  applies  by  setting  d^.  to  a  sufficiently  large  value.  For 
instance,  if  dj^  =  d^  =  |A|maXj.,g^(  }  for  all  k  G.  A,  a 
solution  in  which  the  follower’s  shortest-path  length  is  (7^ 
or  greater  must  indicate  that  all  paths  for  the  follower  have 
been  destroyed.  We  model  only  a  single  interdiction  re- 
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source  constraint  because  some  of  our  algorithmic  special¬ 
izations  require  this,  but  the  basic  approaches  of  Sections  3 
and  5  could  handle  constraints  that  are  more  complicated. 
The  mathematical-programming  formulation  of  MXSP  is 


Problem: 


Indices: 


Data: 


Variables: 


Formulation: 


MXSP:  Maximize  the  shortest  s-t  path 
length  in  a  directed  network  by  interdict¬ 
ing  arcs, 

i  G  N,  nodes  in  G  (^  is  the  source  node,  t 
is  the  sink  node), 
k  =  {i,  j)  £  A,  arcs  in  G, 
k  G  FS{i)  (k  G  RS{i)),  arcs  directed  out 
of  (into)  node  i, 

0  <  Cj^  <  °°,  nominal  integer  length  of  arc 
k  (vector  form  c), 

0  <  dj^  <  °°,  added  integer  delay  if  arc  k 
is  interdicted  (vector  form  d), 
rj^>  0,  resource  required  to  interdict  arc  k 
(vector  form  r), 

Tq,  total  amount  of  interdiction  resource 
available, 

=  1  if  arc  k  is  interdicted  by  the  leader; 
else  x^.  =  0, 

=  1  if  arc  A:  is  traversed  by  the  follower; 
else  y^.  =  0, 


[MXSP-P]  z*  =  max  min  X  (g  +  ^kdk)yk 

y  kBA 


s.t.  Yj  yk-  Yj  yk 

kBFSO)  kBRSii) 


( 1  for  i  =  5 
0  V/GM{s,  f}  (1) 
[  —  1  for  i  =  t 


y,  >  0  V  A:  G  A, 

where  X  =  {x  G  {0,  <  r^}. 

Some  additional  notation  and  comments  are  as  follows: 


1.  X*  will  denote  an  optimal  interdiction  plan. 

2.  Flow-balance  constraints  (1),  in  variables  y,  route  one 
unit  of  flow  from  s  to  f;  the  inner  minimization  is  a 
standard  shortest-path  model  with  arc  lengths  -I-  x^d^- 

3.  Ck  is  the  nominal  length  of  arc  k  and  +  d^  is  the  arc’s 
length  if  it  is  interdicted;  df.  is  finite  and  comprises  such 
factors  as  repair  time  or  the  length  of  a  local  detour  or,  if 
sufficiently  large,  represents  complete  destmction  of  arc 
k. 

4.  Tk  is  typically  a  small  positive  integer;  it  tells  us,  for 
instance,  how  many  weapons  are  required  to  interdict  arc 
k.  Thus,  Tq  is  the  total  number  of  such  weapons  avail¬ 
able. 

5.  Optimal  solutions  in  y  are  assumed  to  be  integral  since 
the  inner  minimization  of  [MXSP-P]  is  a  standard  short- 
est-path  model,  which  has  integral  solutions. 


We  also  note  that  it  is  straightforward  to  extend  [MXSP-P] 
to  handle  undirected  networks  and/or  node  interdiction  and 
to  disallow  interdiction  of  certain  arcs. 

If  we  (;)  fix  x,  {ii)  take  the  dual  of  the  inner  minimization 
in  [MXSP-P],  {Hi)  make  a  few  simple  modifications,  and 
{iv)  then  release  x,  the  following  MIP  results; 

[MXSP-D]  z*  =  max  tt,  —  tt, 

X,7r 

s.t.  TTj  —  TTi  —  dkXk  —  Ck  y  k  =  {i,j)  G  A 

TT^  =  0 

X  GX. 

We  may  assume  that  =  0  because  the  inner  minimiza¬ 
tion  of  MXSP  has  at  least  one  redundant  flow-balance 
constraint  (as  do  all  network  flow  models  containing  a 
balance  constraint  for  each  node).  Also,  note  that  the  dual 
variables  tt  are  unconstrained  in  sign  and,  having  reversed 
their  indicated  signs  compared  to  convention,  we  may  in¬ 
terpret  77,  as  the  postinterdiction  shortest-path  length  from  s 
to  i. 

[MXSP-D]  is  essentially  the  model  explored  by  Fulker¬ 
son  and  Harding  [18]  and  by  Golden  [22],  except  that  those 
authors  required  variables  x  to  be  continuous.  Thus,  their 
model  is  a  simple  linear  program  (LP).  Fulkerson  and  Har¬ 
ding  [18]  suggested  solving  the  dual  of  that  LP  as  a  para¬ 
metric  min-cost  flow  model.  This  approach  does  not  appear 
to  be  useful  for  solving  the  LP  relaxation  of  [MXSP-D], 
because  bounds  x  <  I  needed  by  that  relaxation  cannot  be 
incorporated. 

In  theory,  we  can  solve  MXSP  by  solving  [MXSP-D] 
directly,  that  is,  using  a  standard  LP-based  branch-and- 
bound  algorithm — and  we  will  test  this  approach.  However, 
our  decomposition  approaches  exploit  the  rapid  solvability 
of  shortest-path  problems,  which  branch  and  bound  cannot, 
and  these  approaches  lead  to  a  generalization  of  integer 
cutting  planes  which  achieves  speedups  in  both  the  decom¬ 
position  and  direct  solutions.  Unfortunately,  both  the  direct 
method  and  our  “basic  decomposition”  suffer  from  weak  LP 
relaxations  when  the  dk  are  large.  Another  decomposition 
approach  described  in  Section  5  helps  mitigate  this  diffi¬ 
culty.  Interestingly,  techniques  derived  from  that  approach 
are  also  useful  in  the  basic  decomposition  when  solving 
problems  having  dkOi  moderate  magnitude. 


3.  A  BASIC  DECOMPOSITION  ALGORITHM 

Our  first  decomposition  algorithm  for  MXSP  applies 
Benders  decomposition  directly  to  [MXSP-P].  (Equiva¬ 
lently,  we  can  decompose  [MXSP-D]  as  follows:  Fix  x,  take 
the  dual  of  the  problem  with  respect  to  tt,  and  release  x  so 
that  a  max-min  problem  results;  see  Garfinkel  and  Nem- 
hauser  [19,  pp.  135-143]).  Let  y  G  (0,  1}'"^!  denote  the 
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arc-path  incidence  vector  corresponding  to  an  s-t  path  P, 
that  is,  =  1  implies  that  arc  ^  is  in  and,  otherwise, 

=  0.  Let  Y  denote  a  collection  of  arc-path  incidence  vectors 
corresponding  to  a  subset  of  all  simple  s-t  paths  in  G.  (A 
path  is  “simple”  if  it  contains  no  cycles.)  For  simplicity,  we 
refer  to  y  as  “a  path”  and  to  Y  as  “a  set  of  paths.”  Also,  let 
D  =  diag(d)  and  define 

[Master(y)-la]  Zy=  max  z 

xEX 

s.t.  z  <  c^y  -f  x^Dy  V  y  G  F  (2) 

[SP-Sub(x)]  zs  =  min  2  (g  +  xA)yk 

r  /tEA 

fl  i  =  s 

s-t.  E  Ft  -  E  Ft  =  1 0  '  £  N\{s,  t} 

kBFSii)  kBRS(i)  [  ~  1  i  =  t 

y,>0  ykGA. 

Let  Y  denote  the  set  of  all  simple  s-t  paths.  For  fixed  x 
=  X,  a  solution  to  the  inner  minimization  of  [MXSP-P],  that 
is,  a  solution  to  [SP-Sub(x)],  always  occurs  at  y  G  Y. 
Therefore,  [Master)  10 -la]  is  an  equivalent,  path-based  for¬ 
mulation  of  [MXSP-P]  when  Y  =  Y.  (Actually,  the  formu¬ 
lations  are  equivalent  even  for  continuous  x  >  0.)  How¬ 
ever,  we  hope  to  solve  [MXSP-P],  at  least  approximately, 
by  sequentially  generating  only  a  small  fraction  of  the  paths 
of  Y  within  a  decomposition  algorithm. 

It  will  be  important  later  to  keep  track  of  the  interdiction/ 
response  pair  (x,  y),  which  denotes  a  specific  interdiction 
plan  X  and  an  optimal,  but  not  necessarily  unique,  response 
y  by  the  follower  to  x.  With  respect  to  a  set  of  such  pairs 
XY,  we  let  X  =  [x|(x,  y)  G  XY]  and  Y  =  {y|(x,  y) 
G  XY] .  A  simple  decomposition  algorithm  to  solve  MXSP 
can  now  be  stated: 

Algorithm  1:  Basic  Benders  decomposition  algorithm  for 
MXSP. 

Input:  An  instance  of  MXSP  and  allowable  optimality 

gap  e. 

Output:  An  e-optimal  interdiction  plan  x®  for  MXSP. 

Step  0:  XY  ^  0;  z  < - z  ^  x  ^  0; 

Step  1:  Solve  [SP-Sub(x)]  for  y  and  objective  value  z*; 
XY  ^  XY  U  (x,  y); 

If  z  <  Zj  then  x'  ^  x  and  z  z*; 

If  z  —  z  ^  e  then  go  to  Step  3; 

Step  2:  Solve  [Master)  10 -la]  for  x  and  objective  value 

zf, 

z  Zf,  li  z  —  z  >  e  then  go  to  Step  1; 

Step  3:  X®  ^  x';  Print  x®;  Stop. 


The  correctness  of  the  algorithm,  as  in  any  Benders 
decomposition  algorithm,  is  based  on  the  following  obser¬ 
vations: 

1.  The  subproblem  finds  an  optimal  follower’s  response  for 
any  interdiction  plan  x.  Hence,  z^  gives  a  lower  bound  on 
the  leader’s  optimal  objective  value. 

2.  [Master) F)- la]  is  equivalent  to  [MXSP-P],  so,  when  F 
C  F,  [Master) F)- la]  is  a  relaxation  of  [MXSP-P]  and  Zj> 
is  an  upper  bound  on  the  interdictor’s  optimal  objective 
value.  [The  master-problem  constraints  (2)  are  called 
“Benders  cuts.”] 

3.  If  the  subproblem  produces  the  same  solution  (a  simple 
s-t  path)  twice,  the  upper  and  lower  bounds  match  and 
the  algorithm  terminates.  The  algorithm  converges  in  a 
finite  number  of  iterations  because  the  number  of  simple 
s-t  paths  is  finite. 

Run  times  in  our  test  problems  are  reduced  up  to  40%  by 
generating  all  optimal  responses  for  a  given  x  and  by  adding 
all  the  corresponding  cuts  to  the  master  problem,  rather  than 
generating  a  single  response  and  cut.  Specifically,  for  fixed 
X,  we  use  the  algorithm  of  Byers  and  Waterman  [11]  to  find 
all  shortest  paths  y,,  /  =  1,  .  .  .  ,  h,  and  add  the  cuts  z 
<  c^fi  -f  I  =  1,  .  .  .  ,  h.  The  resulting  master 

problems  are  harder  to  solve,  but  this  is  usually  offset  by  a 
reduced  number  of  iterations  (repetitions  of  Steps  1  and  2) 
for  the  overall  algorithm. 

4.  SUPER-VALID  INEQUALITIES  FOR  BENDERS 
DECOMPOSITION 

This  section  develops  a  generalization  of  integer  cutting 
planes  to  improve  the  efficiency  of  Algorithm  1  and  dem¬ 
onstrates  the  improved  algorithm  with  an  example. 

4.1.  Basic  Theory 

To  strengthen  the  LP  relaxation  of  [Master) F)- la],  we 
introduce  the  concept  of  a  supervalid  inequality  (SVI), 
which  may  be  viewed  as  a  generalization  of  the  standard 
“valid  inequality”  (which  is  essentially  the  same  as  an 
“integer  cutting  plane”  or  “cut,”  e.g.,  Nemhauser  and  Wol- 
sey  [34,  pp.  205-295],  and  Wolsey  [44,  pp.  113-124]). 
Standard  valid  inequalities  applied  to  the  master  problem 
would  not  eliminate  any  feasible  x,  but  would,  normally, 
reduce  the  size  of  the  feasible  region  of  that  problem’s  LP 
relaxation.  On  the  other  hand,  our  SVIs  typically  make  the 
most  recent  solution  x  infeasible  and  may  make  other  inte¬ 
ger  solutions  infeasible,  thereby  reducing  the  size  of  the 
feasible  region  of  the  LP  relaxation  under  consideration.  But 
these  inequalities  are  guaranteed  not  to  eliminate  any  opti¬ 
mal  solutions  unless  the  incumbent  is  itself  optimal. 

Definition  1.  Let  v  and  x  denote,  respectively,  the  vectors 
of  continuous  and  integer  variables  in  an  MIP,  let  Wj  and 
W2  be  two  conforming  vectors  of  constants,  respectively, 
and  let  Wq  be  a  scalar  constant.  The  inequality  wfv  +  wfx 
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&  Wq  is  supervalid  for  this  MIP,  that  is,  it  is  a  supervalid 
inequality  for  the  MIP,  if  (?)  adding  that  inequality  to  the 
MIP  does  not  eliminate  all  optimal  solutions  or  (ii)  an 
incumbent  solution  to  the  MIP,  (v',  x'),  is  (already)  optimal. 


Hooker  [25]  and  Atamtiirk  et  al.  [3]  also  used  inequali¬ 
ties  that  are  invalid  in  the  standard  sense;  Hooker  calls  them 
“nonvalid  cuts.”  In  particular,  feasible  solutions  may  be 
eliminated  through  their  inequalities,  although,  unlike  SVIs, 
no  optimal  solutions  are.  In  theory,  SVIs  can  be  used,  when 
solving  an  MIP  like  [MXSP-D]  by  branch  and  bound,  to 
help  fathom  nodes  in  the  enumeration  tree.  In  fact,  we  do 
just  that  in  Section  7.3.  However,  we  develop  and  demon¬ 
strate  SVIs  in  the  context  of  [Master(}0-la]. 

Theorem  1.  For  any  Benders  cut  z  —  c^y  +  x^/)y  in 
[Master(Y)-\d\,  the  Type-I  inequality  y^x  >  I  is  supervalid 
for  [Master(Y)-\a]. 

Proof.  The  statement  presupposes  that  X  is  nonempty 
and  that  some  feasible  interdiction/response  pair  (x,  y)  has 
generated  the  Benders  cut  z  ^  c^y  +  x^Dy.  Let  z  =  c^y 
+  x^Dy.  If  the  incumbent  solution  is  optimal,  then  any 
inequality  in  x  is  supervalid,  so  suppose  not,  that  is,  suppose 
that  the  incumbent  has  led  to  z  <  z*.  Let  (z*,  x*)  denote 
an  optimal  solution  to  [Master(y)-la]  and  note  that  y^x*  = 
0  or  y^x*  >  1.  When  y^x*  =  0, 

z*  <  c^y  +  (x*)^Dy  is  true  for  any  y  G  Y  G  X, 

=  z  +  (x*)^Dy  —  x^Dy  because  z  =  c^y  +  x^Dy, 

<  z  because  y^x*  =  0  implies  that  (x*)^Dy  =  0, 

and  because  d  >  0,  y  >  0,  and  x*  >  0  imply  that 
x^Dy  >  0, 

<  z  because  x  need  not  be  the  incumbent  solution,  and 

<  z*  by  assumption;  but  this  is  a  contradiction. 

Therefore,  if  the  incumbent  solution  is  not  optimal,  y^x*  > 
1  must  be  true  for  every  optimal  solution  (z*,  x*).  Thus,  by 
definition,  the  inequality  y^x  >  1  is  supervalid.  ■ 

Note  that  if  y^x  =  0  for  a  pair  (x,  y)  the  inequality  y^x 
>  1  makes  x  infeasible.  Thus,  y^x  >  1  need  not  be  a  valid 
inequality  in  the  standard  sense. 

Theorem  1  has  a  simple  interpretation:  If  an  objective 
value  better  than  z  is  ever  to  be  obtained,  we  must  “raise  the 
ceiling”  imposed  by  c^y  +  x^Dy  in  the  Benders  cut  z  ^  c^y 
+  x^Dy  to  at  least  z  (which  is  no  greater  than  z)  by  forcing 
x^Dy  to  be  sufficiently  large. 

Sometimes,  interdiction  of  a  single  arc  does  not  raise  the 
ceiling  high  enough  and  the  following  corollary  applies: 

Corollary  1.  Given  the  Benders  cut  z  —  c^y  +  x^Dy, 
order  the  d/fp.  >  0  so  that  dp^y^^  &  •  ■  •  >  Then, 

if  z  a  c^y  +  d/^^i^^forp  <  L,  the  Type-I  SVI  of  Theorem 

1  can  be  tightened  to  y^x  >  p  1. 


Proof.  Analogous  to  Theorem  1 ,  if  the  current  solution 
is  not  optimal,  then  constraints  z  ^  c^y  -I-  x^Dy  and  y^x  < 
p  and  the  condition  z  >  c^y  +  imply  that  z*  ^ 

c^y  +  2/’=!  ^  optimal  solution  (z*,  x*). 

This  is  a  contradiction,  so  y^x  >  p  -\-  \  must  be  supervalid. 

■ 

We  next  develop  “Type-II  SVIs”  which  may  be  viewed 
as  “lifted”  versions  of  Type-I  SVIs  (although  they  will 
sometimes  be  identical). 

Theorem  2.  Let  XY  be  a  set  of  interdiction! response  pairs 
generated  up  to  some  point  in  Algorithm  1 ,  and  suppose  that 
(x,  y)  G  XY.  Define  y  =  (diag(\  —  x))y.  Then,  the  Type-II 
inequality  y^x  >  1  is  supervalid  for  \Master(Y)-\a\ 

Proof.  If  the  interdictor  is  ever  to  see  a  response  from 
the  follower  that  is  different  and  longer  than  y,  then  he  must 
interdict  some  arc  that  was  traversed  in  y  but  not  interdicted. 
This  is  precisely  the  set  of  arcs  in  the  uninterdicted  subpath 
defined  by  y.  ■ 

Given  (x,  y)  G  XY,  the  Type-I  SVI  y^x  >  1  and 
corresponding  Type-II  SVI  y^x  >  I  will  be  identical  if  the 
follower  traverses  no  interdicted  arcs  in  y,  that  is,  if  y^x  = 
0,  so  that  y  =  y.  But  if  y^x  >  0,  then  y  ^  y  and  0  = 

<  =  1  for  at  least  one  arc  k,  and,  therefore,  the  Type-II 

SVI  is  stronger  than  its  Type-I  counterpart.  This  strength¬ 
ening  is  analogous  to  “lifting”  for  valid  inequalities  (e.g., 
Nemhauser  and  Wolsey  [34,  pp.  261-267]),  so  we  borrow 
that  term  here.  Type-II  SVIs  can  be  lifted  through  other 
considerations  described  next. 

Theorem  3.  Suppose  that  the  pair  (Xj,  yj)  G  XY  in  Algo¬ 
rithm  1  generates  the  Type-II  SVI  yfx  >  1.  Let  =  (A:|yi^ 
=  1 1  and  let  K2  be  any  subset  of  such  that  dp. 

4-  (c^yj  +  x^Dy^)  <  z.  Then,  the  following  inequality  is 
supervalid'.  y^x  >  1,  where  y^p^  =  k  G  KfK2 

y2p  =  0,  otherwise. 

Proof.  To  achieve  any  solution  of  value  greater  than  z, 
we  must  find  x  such  that  c^yi  -f  x^Dy^  >  z,  which  requires 
that  some  arc  from  y  j ,  other  than  or  in  addition  to  those  with 
indices  K2,  be  interdicted.  ■ 

The  inequality  yfx  >  1  is  a  lifted  Type-II  SVI  and  should 
replace  its  progenitor  yfx  >  1 . 

Naturally,  K2  should  be  a  maximal  set  with  the  property 
that  dp  +  (c^yi  +  x^Dyj)  <  z.  In  practice,  we  order 

the  indices  of  =  {k^,  k2,  .  .  .  ,  k^}  so  that  dp^  s  dp^ 
^  ^  dp  and  define  K2  ~  {^i>  ■  •  ■  >  ^/vl  that 

^keic,  dp  +  (c  yj  +  XjDyj)  <  z,  but  dp 

+  (c^y,  +  x\Dyp)  >  z.  The  ordering  may  not  be  unique, 
and  there  may  be  other  ways  to  define  maximal  subsets  K2, 
so  it  may  be  possible  to  lift  y^x  >  1  in  different  ways  to 
produce  different  lifted  SVIs.  This  nonunique  lifting  is  akin 
to  the  sequence-dependent  lifting  of  valid  inequalities,  for 
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example,  Padberg  [36]  and  Balas  and  Zemel  [4].  In  practice, 
we  only  attempt  to  lift  an  SVI  with  respect  to  a  single 
ordering. 

The  enhanced  version  of  Algorithm  1  generates  at  least 
one  Type-I  SVI  and  one  Type-II  SVI  in  each  iteration. 
These  SVIs  may  he  identical,  but  typically  diverge  through 
tightening  and/or  lifting.  Lifting  and/or  tightening  is  at¬ 
tempted  as  soon  as  an  SVI  is  generated  and  whenever  z 
changes  during  the  course  of  the  algorithm. 

4.2.  Algorithm  1  with  SVIs:  An  Example 

Here,  we  demonstrate  the  application  of  SVIs  to  Algo¬ 
rithm  1  through  an  example.  In  every  iteration,  we  add  to 
the  master  problem  one  Benders  cut,  one  Type-I  SVI,  and 
one  Type-II  SVI  and  then  attempt  to  tighten  or  lift  those 
SVIs  along  with  previously  generated  SVIs.  The  final  ver¬ 
sion  of  Algorithm  1  depends  on  techniques  developed  in  the 
context  of  a  decomposition  discussed  later,  so  we  revisit 
Algorithm  1  in  Section  6. 

Example  1.  Consider  a  network  containing  s-t  paths  Pj 
and  P2,  among  others'.  Pj  consists  of  arcs  1,  2,  and  3  and  P2 
consists  of  arcs  1,  4,  and  5.  Those  arcs  have  the  following 
parameters:  Cj  =  3,  C2  =  1,  C3  =  8,  C4  =  4,  C5  =  6,  di  =  3, 
d2  =  4,  d^  =  5,  d^  =  1,  and  d^  =  3.  Suppose  that  Pj  is  the 
shortest  s-t  path  in  the  network  and,  hence,  is  returned  by 
the  subproblem  in  the  first  iteration  of  the  algorithm  when  x 
=  0.  Therefore,  z  =  12,  and  the  first  Benders  cut  of  the 
master  problem  is 

Bendersi:  z  <  12  -f  3x1  +  4x2  +  5x3. 

The  associated  Type-I  and  Type  II  SVIs  complete  this 
iteration’s  master  problem: 

I- SVIp  Xi  -1-  X2  +  X3  s  1, 

II- SVIii  Xi  -f  X2  +  X3  s  1. 

Suppose  that  the  interdictor  has  enough  resource(s)  to 
interdict  arcs  1,  2,  and  3  together  and  that  this  is  the 
solution,  with  z  =  24,  of  the  first  master  problem,  which 
consists  of  BenderSj,  I-SVIj,  and  II-SVIj.  Further,  assume 
that  the  shortest  s-t  path  given  these  interdictions  is  P2,  so 
that  z  =  Ci  +  di  -l-C4  +  Cg=  16.  We  can  therefore  lift 
II-SVIi  because  interdiction  of  arc  1  alone  cannot  raise  the 
ceiling  on  z  over  the  lower  bound  z  =  16.  (We  could  also 
lift  this  constraint  by  noting  that  interdiction  of  arc  2  alone 
is  insufficient  to  raise  the  ceiling  above  16,  but  we  follow 
the  discussion  after  Theorem  3  and  lift  only  with  respect  to 
the  first  indication.)  The  constraints  from  the  first  iteration 
are  now 

BenderSi!  z  s  12  4-  3xi  3-  4x2  +  5x3, 

I- SVIi!  Xi  -I-  X2  +  X3  >  1, 

II- SVIi!  X2  +  X3  &  1, 


and  the  constraints  from  the  second  iteration  are 

Benders2:  z  ^  13  +  3xi  -f  IX4  +  3x5, 

I- SVI2:  Xj  4-  X4  4-  X5  &  2, 

II- SVI2:  X4  4-  X5  &  1, 

where  we  have  already  tightened  I-S  VI2  by  Corollary  1 .  The 
new  master  problem  incorporates  the  six  constraints  above. 
Suppose  that  its  solution  is  Xj  =  X3  =  X4  =  Xg  =  1  and  X2 
=  0,  so  that  z  =  20  and  the  algorithm  continues. 

Then  suppose  that  z  increases  to  17  at  some  later  itera¬ 
tion.  We  can  then  tighten  the  right-hand  side  of  I-SVIj  to  2, 
because  to  raise  z  over  z  we  must  interdict  at  least  two  of  the 
three  arcs  in  Pj.  We  can  also  lift  II-SVI2,  because  interdic¬ 
tion  of  arc  4  (along  with  arc  3)  cannot  raise  z  over  z  =  17. 
The  master  problem  derived  from  the  first  two  iterations  is 
now  (constraints  from  any  subsequent  iterations  are  omit¬ 
ted) 


Bendersi! 

z  ^ 

12  4-  3xi 

4-  4X2  +  5X; 

I-SVIi: 

Xi  4-  X2  4-  X3  & 

2, 

II-SVIi: 

X2  4-  X3  > 

1, 

Benders2: 

z  s 

13  4-  3xi 

4-  1X4  4-  3x; 

I-SVI2: 

Xl  4-  X4  4-  Xg  > 

2, 

II-SVI2: 

Xg  > 

1. 

The  algorithm  may  or  may  not  halt  now  depending  on  the 
other  cuts  that  have  been  generated  and  the  value  of  z 
obtained  after  solving  the  current  master  problem. 

5.  A  COVERING  DECOMPOSITION 

The  special  decomposition  algorithm  described  here  is 
particularly  useful  for  problems  in  which  interdictions  de¬ 
stroy  arcs,  thereby  making  them  impassable. 

5.1.  Arc  Destruction:  A  Caveat 

Problems  in  which  arcs  are  actually  destroyed  by  inter¬ 
diction  can  be  modeled  by  setting  each  dj^  =  d^ ,  where  d^ 
is  a  sufficiently  large  “artificial  delay.”  Unfortunately,  Al¬ 
gorithm  1  ’  s  master  problem  becomes  weaker  and  harder  to 
solve  as  d^  increases  in  value  with  respect  to  c^;  this  is 
clear  in  theory  and  is  demonstrated  empirically  in  Section 

7.2.  Thus,  it  is  tempting  to  guess  at  a  modest  value  for  d^ 
and  hope  that  the  guess  is  large  enough.  But  the  following 
example  shows  that  being  too  conservative  with  d^  can  lead 
to  difficulties. 

Example  2.  Consider  the  network  of  Figure  1  and  sup¬ 
pose  that  an  interdictor  can  destroy  any  two  arcs  in  that 
network.  One  optimal  solution  to  MXSP  interdicts  (^,  a)  and 
{s,  b),  yielding  a  shortest  s-t  path  length  of  20.  Let  d^  be  the 
artificial  delay  to  be  added  to  each  interdicted  arc,  and  let 
us  use  Algorithm  1  without  SVIs  to  solve  this  problem. 
Initially,  the  algorithm  finds  the  uninterdicted  shortest 
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FIG.  1.  Network  to  illustrate  difficulties  with  artificial  delays.  Numbers 
next  to  arcs  denote  arc  lengths. 

path  s-a-t  with  length  2.  Given  that  solution  for  the  fol¬ 
lower,  the  leader  interdicts  {s,  a)  and  {a,  t),  and  solves  the 
master  problem  containing  the  single  Benders  cut  z  ^  2 
+  d^x^^  +  d^x^j.  The  solution  yields  the  ‘"quasi-upper 
bound"  of  2  +  2d^:  This  is  a  “quasi-bound"  because  it  is 
valid  only  if  d^  S  9.  The  follower  then  finds  the  shortest 
path  after  {s,  a)  and  {a,  t)  are  removed  from  the  network. 
The  solution  is  s-b-t,  with  length  12,  and  the  master  prob¬ 
lem"  s  cuts  are 

2^2  +  +  d^Xatfrom  the  first  iteration,  and 

z  <  12  +  +  d^x^ffrom  the  second  iteration. 

There  are  four  cases  to  consider  now: 

(a)  If  <5,  the  shortest  path  from  the  second  iteration 
has  length  greater  than  the  quasi-upper  bound  from  the 
first  iteration.  We  conclude  that  cG  is  too  small,  in¬ 
crease  it,  and  return  to  the  master  problem. 

(b)  If  5  <  <  10,  the  optimal  master  problem  objective, 

that  is,  the  quasi-upper  bound,  is  12.  Since  the  lower 
bound  and  quasi-upper  bound  match,  the  algorithm 
terminates,  but  with  an  incorrect  solution.  In  this  case, 
we  see  no  way  to  recognize  that  we  have  chosen  d^  too 
small  without  solving  this  NP-complete  problem:  Does 
there  exist  a  solution  to  MXSP  with  an  objective  value 
greater  than  Zf? 

(c)  If  10  <  d^  <  18,  the  master  problem  interdicts  both 
paths  and  has  the  optimal  objective  value  2  -\-  d^.  The 
third  iteration  of  the  subproblem  finds  the  path  s-c-t 
with  length  20,  which  is  larger  than  is  the  current 
quasi-upper  bound.  Again,  we  conclude  that  d^  is  too 
small,  increase  it,  and  return  to  the  master  problem. 

(d)  If  d^  S  18,  the  quasi-upper  bound  is  a  true  upper 

bound  and  the  algorithm  terminates  with  the  optimal 
solution.  m 

5.2.  The  Basic  Covering  Algorithm 

Case  (b)  above  is  disturbing.  To  address  this  and  related 
issues,  we  offer  an  alternative  decomposition  algorithm  that 
eliminates  the  delay  terms  from  the  master  problem.  The 
master  problem  is  simply  a  “feasibility-seeking  set-covering 
problem”: 


[Master(Xy)  —  2a]  Find  xGX 

s.t.  y^x  >1  V  (x,  y)  G  XY  where  y  =  (diag(l  —  x))y. 

In  this  context,  we  call  the  constraints  y^x  >  1  covering 
constraints  and  each  such  constraint  simply  implies  that  “if 
the  interdictor  wishes  to  force  the  follower  to  traverse  a  path 
other  than  y  then  a  new  interdiction  plan  x'  must  interdict 
some  arc  that  is  not  interdicted  by  x  but  is  used  by  the 
follower  in  response  to  x.” 

The  algorithm  associated  with  [Master(Z}0-2a]  gener¬ 
ates  new  interdiction  plans  until  the  master  problem  be¬ 
comes  infeasible,  at  which  point  we  can  prove  that  the  best 
plan  found  is  optimal.  We  refer  to  this  algorithm  as  a 
covering  decomposition. 

Algorithm  2:  A  covering  decomposition  algorithm  for 
MXSP. 

Input:  An  instance  of  MXSP. 

Output:  An  optimal  interdiction  plan  x*. 

Step  0:  XY  0;  z  < - x  0; 

Step  1:  Solve  [SP-Sub(x)]  for  y  with  objective  value  z^; 

XY  ^  XY  U  (x,  y); 

If  z  <  Zs  then  x'  x  and  z  z*; 

Step  2:  Attempt  to  solve  [Master(Xy)-2a]  for  feasible 
solution  x; 

If  [Master(X10-2a]  is  feasible  then  go  to  Step  1; 
Step  3:  X*  ^  x';  Print  x*;  Stop. 

Theorem  4.  Algorithm  2  correctly  solves  MXSP. 

Proof.  Define  z(x,  y)  =  c^y  +  x^Dy  for  all  (x,  y) 
G  XY.  Now,  we  may  view  Algorithm  2  as  follows:  Each 
time  the  algorithm  reaches  Step  1,  the  follower  responds  as 
best  possible  to  the  current  interdiction  plan  x  with  one  new 
s-t  path  y  and,  implicitly,  with  an  uninterdicted  subpath  y. 
Then,  in  Step  2,  the  leader  tries  to  find  a  plan  that  interdicts 
at  least  one  arc  in  each  of  the  uninterdicted  subpaths  gen¬ 
erated  so  far.  (If  such  a  plan  is  found,  it  may  or  may  not 
force  the  follower  to  traverse  a  path  longer  than  the  path 
forced  by  the  incumbent  x'.)  The  algorithm  terminates 
when  the  leader  fails  to  interdict  all  the  subpaths  represented 
by  XY.  At  this  point,  he  cannot  force  a  worse  response  for 
the  follower  than  any  of  responses  seen  so  far,  that  is,  z*  ^ 
maX(s  z(x,  y).  But  z  =  maX(j  z(x,  y),  so  the 
incumbent  solution  x'  is  optimal.  ■ 

The  correctness  of  Algorithm  2  can  also  be  proved  via  a 
variant  of  Benders  decomposition  in  which  the  master  prob¬ 
lem  is  not  solved  to  optimality;  see  Israeli  [27]. 

If  arcs  are  actually  destroyed  by  interdiction.  Algorithm 
2  can  be  applied  directly  with  sufficiently  large  artificial 
delays  representing  arc  destruction  in  the  subproblem  or  by 
simply  making  interdicted  arcs  impassable.  (In  either  case. 
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FIG.  2.  Network  for  counterexample.  If  all  arcs  lengths  are  1  and  exactly  two  ai'cs  can  be  interdicted,  the 
optimal  solution  to  MXSP  interdicts  arcs  (5,  c)  and  (c,  t)  which  are  not  part  of  any  cutset. 


y  =  y  for  all  follower  responses  y,  unless  it  is  possible  for 
the  interdictor  to  disconnect  s  from  t,  in  which  case  the 
algorithm  can  be  modified  to  terminate  early.)  In  fact,  when 
applied  to  such  a  problem,  Algorithm  2  is  similar  to  the 
algorithm  for  the  “A:-most-vital-arcs-problem”  suggested  by 
Malik  et  al.  [30].  There,  paths  with  nondecreasing  lengths  in 
the  uninterdicted  network  are  enumerated  and  interdiction  is 
attempted  in  the  network  G'  consisting  of  the  union  of  the 
first  /  paths,  for  /  =  1,  2,  ,  until  this  is  impossible. 

Essentially,  an  algorithm  that  produces  the  /^-shortest  path 
in  the  original  network  (e.g.,  [29])  replaces  Step  1  in  Algo¬ 
rithm  2.  However,  Malik  et  al.  assumed  that  an  optimal 
interdiction  plan  x*  for  the  /  shortest  paths  must  correspond 
to  a  cutset  in  G',  and,  thus,  x*  corresponds  to  an  easily 
identified,  minimum-cardinality  cutset  in  G' .  Figure  2’s 
counterexample  shows  that  this  assumption  is  incorrect,  so 
the  procedure  of  Malik  et  al.  must  be  viewed  as  a  heuristic. 

We  next  describe  some  enhancements  to  Algorithm  2  to 
improve  efficiency. 

5.3.  Heuristic  Solution  of  the  Master  Problem 

Since  we  assume  that  X  includes  only  a  single  resource 
constraint  r^x  <  rg,  we  can  solve  the  following  master 
problem  to  find  a  solution  to  [Master) A -2a]: 

[Master(Ay)-2b]  min  r^x 

s.t.  y^x  >  1  V  (x,  y)  £  XY 

where  y  =  (diag(l  —  x))y 

X  £{0, 

[Master) A 10 -2b]  is  a  standard  set-covering  problem  )SCP), 
which  has  an  optimal  objective  value  not  exceeding  Tq  if 
and  only  if  [Master)  A  A) -2a]  is  feasible.  However,  we  need 
only  solve  [Master)Ai^-2b]  for  a  feasible  solution  x  satis¬ 
fying  r^x  <  Tg,  and  this  suggests  the  use  of  fast  heuristics. 
We  use  a  version  of  the  greedy  heuristic  for  SCPs  discussed 
by,  among  others,  Nemhauser  and  Wolsey  [34].  [Other  SCP 
heuristics  exist,  e.g.,  Beasley  [8]  and  Caprara  et  al.  [12],  but 
our  choice  is  easy  to  implement  and  provides  adequate 
performance  for  our  test  problems.)  Thus,  whenever  we 


need  to  solve  a  master  problem  in  Algorithm  2,  we  run  the 
greedy  heuristic  on  [Master) AT) -2b].  If  a  feasible  solution, 
X  £  A,  is  found,  we  proceed  to  Step  1  of  the  algorithm.  If 
not,  only  then  do  we  resort  to  a  slower,  exact,  branch-and- 
bound  algorithm. 

5.4.  Local  Search 

Algorithm  2  typically  iterates  faster  than  does  Algorithm 

1  because  the  master  problems  are  easier  to  solve.  This  is 
true  even  when  delays  dp.  are  small.  On  the  other  hand. 
Algorithm  2  usually  requires  more  iterations  than  does 
Algorithm  1  when  the  dp  are  not  too  large.  Another  diffi¬ 
culty  with  Algorithm  2  is  the  lack  of  an  upper  bound,  which 
could  enable  early  termination  with  a  near-optimal  solution. 
To  help  overcome  these  two  difficulties,  we  exploit  multiple 
pairs  )x,  y')  generated  by  a  local-search  procedure  for  a 
given  X,  where  y'  denotes  an  optimal  or  suboptimal  re¬ 
sponse  to  X.  The  key  result  is 

Theorem  5.  Let  )x,  y')  denote  an  interdiction  plan  x  and 
possibly  suboptimal  response  y',  that  is,  f  is  a  valid  path 
given  X,  but  may  not  be  a  shortest  path.  Then,  )x,  y')  may  be 
added  to  XY  without  compromising  the  validity  of  Algorithm 

2  provided  that  z)x,  y')  <  z. 

Proof.  This  follows  from  the  dehnition  of  z.  ■ 

Before  describing  the  related  upper-bounding  procedure, 
we  describe  a  local-search  process  that  generates  the  “extra 
pairs”  )x,  y'). 

Assume  that  G  has  arc  length  vector  c  -I-  Dx.  It  is  well 
known  that  finding  the  shortest  paths  from  s  to  all  other 
nodes  in  G  is  not  much  more  difficult  than  finding  a  single, 
shortest  s-t  path.  So,  we  first  compute  and  encode  the 
former  paths  using  a  standard  “shortest-path  tree”  T  and 
“predecessor  function”  )e.g.,  Ahuja  et  al.  [1,  pp.  106-107]). 
Now,  let  P(t)  =  {s,  (j,  ij,  .  .  .  ,  i„,  t)  denote  the  shortest 
s-t  path  in  T  and  let  P(j)  be  the  shortest  s-j  path.  For  every 
node  £  {('i,  ij,  .  .  .  ,  and  for  every  arc  {j,  i„,)  £  A, 
j  ^  P(t),  the  procedure  Local_Search)x,  T)  then  builds  the 
path  (Pij),  i,„+i,  .  ■  ■  ,  t),  represented  by  its  inci¬ 

dence  vector  y'  and  returns  the  corresponding  pair  )x,  y'). 
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We  omit  pseudocode  for  this  procedure  and  other  ancillary 
procedures  whose  implementations  are  straightforward. 

Every  pair  (x,  y')  returned  from  Local_Search(x,  T) 
with  z(x,  y')  <  2  is  introduced  into  XY  to  yield  one  more 
suhpath  to  be  covered  in  the  master  problem.  If  z(x,  y') 
>  z,  (x,  y')  is  stored  in  a  special  set  XY^ .  Later,  after 
updating  z  in  succeeding  iterations,  any  (x,  y')  £  XY^ 
satisfying  z(x,  y')  <  z  is  moved  into  XY.  Based  on  The¬ 
orem  6  below,  the  paths  contained  in  XY^  can  also  be  used 
to  verify  a  hypothesized  upper  bound,  for  example,  z  -I-  e 
for  some  e  >  0,  which  then  allows  us  to  solve  for  e-optimal 
solutions. 

Theorem  6.  Let  XY^  be  defined  such  that  z(x,  y')  —  zfor 
all  (x,  y')  G  XY^,  where  z  is  a  hypothesized  upper  bound  on 
z*.  Then,  if  [Master{XYf)-2b]  is  infeasible,  z*  ^  z,  that  is, 
the  upper  bound  is  valid. 

Proof.  Let  XYl  denote  the  set  of  all  interdiction  plans 
and  possible  optimal  and  nonoptimal  responses  (x,  y')  such 
that  z(x,  y')  ^  z.  If  z*  >  z,  we  can  feasibly  interdict  all 
uninterdicted  subpaths  y'  derived  from  (x,  y')  G  XY^  D 
XY^.  But,  under  the  assumption  that  [Master(XFj)-2b]  is 
infeasible,  this  is  impossible.  Therefore,  z*  ^  z.  ■ 

So,  given  valid  lower  bound  z  derived  from  some  x,  we 
can  check  for  e-optimality  of  x  by  (/)  hypothesizing  an 
upper  bound  z  =  z  +  e  for  some  e  >  0,  (ii)  defining  XY= 
=  XY  U  {(x,  y')  G  Zf^|z(x,  y')  <  z  -I-  e},  and,  (Hi) 
checking  feasibility  of  []VIaster(ZTj)-2b].  If  it  is  infeasible, 
we  know  that  z*  ^  Z  +  e  and  x  is  e-optimal.  When  e  >  0 
is  defined,  we  generate  and  solve  [Master(Zyj)-2b]  period¬ 
ically  within  Algorithm  2  and  find  that  the  extra  computa¬ 
tional  overhead  is  more  than  offset  by  a  reduced  number  of 
iterations. 

5.5  Other  Improvements 

Algorithm  2  adds  two  procedures  that  often  improve 
efficiency.  One  procedure.  Lift(ZT,  z),  uses  the  current 
lower-bound  z  and  information  on  arcs  with  modest  delays 
to  lift  the  covering  constraints  based  on  XY,  just  as  Type-II 
SVIs  are  lifted  via  Theorem  3:  Covering  constraints  are 
essentially  Type-II  SVIs.  [The  procedure  returns  the  “lifted 
interdiction/response  pairs”  derived  from  (x,  y)  G  XY 
rather  than  the  lifted  constraints  themselves.]  Additionally, 
we  generalize  the  procedure  and  call  Lift(VT,  z  3-  e),  for 
e  >  0  to  create  s-supervalid  inequalities  (e-SVIs).  These 
inequalities  will  not  eliminate  all  e-optimal  solutions  unless 
the  incumbent  solution  is  already  e-optimal. 

Another  procedure,  not  shown,  removes  redundant  rows 
from  the  master  problem  just  as  such  rows  are  removed  in 
set-covering  problems  (e.g.,  Garfinkel  and  Nemhauser  [19, 
pp.  302-304]  and  Taha  [38,  pp.  316-332]).  We  find  it  more 
efficient  to  do  this  before  sending  the  master  problem  to  the 
solver,  although  the  solver  can  detect  and  remove  some  or 
all  of  these  rows  by  itself. 


5.6.  The  Enhanced  Covering  Decomposition 

Algorithm  2,  with  enhancements,  is  outlined  below.  The 
actual  implementation  reorders  certain  computations  for 
efficiency’s  sake. 

Algorithm  2E:  Enhanced  covering  decomposition  for 
MXSP. 

Input:  An  instance  of  MXSP  and  optimality  tolerance  e 

>  0. 

Output:  An  e-optimal  interdiction  plan  x®  for  MXSP. 

Step  0:  XY  0;  Xf+  ^  0;  z  < - x  ^  0; 

Step  1:  Solve  [SP-Sub(x)]  for  shortest-path  tree  T  and 
objective  z*; 

If  z  <  Zs  then  x'  ^  x  and  z  z*; 

XY^  ^  XY^  U  LocaI_Search(x,  T); 

XY'  ^  [(x,  y')  G  Xf+|z(x,  y')  <  z  -f  e]; 
XY^  ^  XY^  -  XY' ; 

XY'  ^  Lift(Xf',  z  +  e); 

Step  2:  Attempt  to  solve  [Master(Xy')-2b]  for  feasible 
solution  X. 

If  [Master(XT')-2b]  is  feasible,  then  go  to  Step 
1. 

Step  3:  X®  <—  x';  Print  x®;  Stop. 


6.  ALGORITHM  1  REVISITED 

Algorithm  2’s  enhancements  can  also  improve  Algo¬ 
rithm  1,  as  can  a  few  other  techniques  described  here. 
Algorithm  IE  is  the  result. 


6.1.  SVIs  and  the  Master  Problem 

Algorithm  1  works  best  when  all  optimal  responses  y  for 
a  given  x  are  generated  and  the  corresponding  cuts  added  to 
the  master  problem,  but  suboptimal  responses  y  can  also  be 
used.  They  create  “slack  Benders  cuts”  that  lie  strictly  above 
the  function  z^  at  the  points  x  =  x  G  X  that  generate  these 
cuts.  Slack  cuts  often  tighten  the  master  problem  away  from 
X  and  thereby  reduce  enumeration,  so  we  use  Local_Search 
just  as  in  Algorithm  2E  to  generate  the  necessary  paths.  (We 
could  also  use  the  Byers  and  Waterman  algorithm,  but  find 
it  overly  sensitive  to  parameter  settings  in  our  tests.) 

The  master  problem  for  Algorithm  IE  includes  both 
Type-I  and  Type-II  SVIs.  To  use  both  types,  we  maintain 
the  set  XY  as  defined  in  Algorithm  1  and  second  set  XY'  of 
interdiction/response  pairs  that  are  augmented  and  lifted  by 
Local_Search  and  Lift,  respectively.  The  right-hand  sides 
b  for  Type-I  SVIs  are  defined  as  functions  by  combining 
Theorem  3  and  Corollary  1  as  follows:  For  each  (x,  y) 
G  XY,  order  the  >  0  such  that  > 

du  Vu  and  define  d,yu=^,du  Vj.  =0  and 
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►  Not  interdictable 
Interdictable 


b{c^y,  d,  z)  =  +  1  if 

p  p+i 

c^y  +  2  di^Sk,  s  z  <  c^y  +  X  d,,,ykr 

1=1  1=1 

Just  as  Type-II  SVIs  are  generalized  to  e-SVIs,  the  Type  II 
SVIs  are  also,  simply  by  using  bic^y,  d,  z  +  e).  The  master 
problem  for  Algorithm  IE  is  then 

[Master(Af,Ay',z,  e)-lb] 

ZxY  =  max  z 

xEX 

s.t.  Z  ^  c^y  +  x^ZJy  V  y  G  F 

y^'x  >  b(c^y,  d,  z  +  e)  V  (x,  y)  G  XY 

y^x  >1  V  (x,  y)  G  XY'  where  y  =  (diag(l  —  x))y. 

6.2.  Algorithm  IE 

We  outline  Algorithm  IE  as  follows: 

Algorithm  IE:  The  Benders  decomposition  Algorithm 
1,  enhanced. 

Input:  An  instance  of  MXSP  and  optimality  tolerance  e 

>  0. 

Output:  An  e-optimal  interdiction  plan  x®  for  MXSP. 
Step  0:  XY  ^  0;  XY^  ^  0;  z  < - z  ^  x  ^ 

0; 

Step  1:  Solve  [SP-Sub(x)]  for  shortest-path  tree  T  and 
objective  Zj. 

If  z  <  Zj  then  x'  ^  x  and  z  Zj; 

Xf+  ^  Xf+  U  Local_Search(x,  T); 


XY'  ^  {(X,  y')  G  Xf+|z(x,  y')  <  Z  +  e}; 

^  -  XY' ; 

XY'  ^  Lift(XF',  z  +  e); 

Step  2:  Attempt  to  solve  [Master(Xf,  XY' ,  z,  e)-lb]  for 
optimal  solution  x  and  objective  Zxf^ 

If  [Master(XF,  XY' ,  z,  e)-lb]  is  infeasible,  then 
go  to  Step  3; 

z  ^  zgf.  If  z  -  z  >  e  then  go  to  Step  1 ; 

Step  3:  X®  ^  x' ;  Print  x®;  Stop. 

In  addition  to  using  SVIs,  solution  times  for  Algorithm 
IE  are  often  reduced  by  not  solving  the  master  problem  to 
optimality.  This  variant  of  Benders  decomposition  (e.g., 
[20])  will  converge  provided  that  (/)  a  suboptimal  integer 
master-problem  solution  x  is  accepted  only  if  the  corre¬ 
sponding  objective  value  z'  satishes  z'  >  z  and  (h)  we 
update  z  only  when  the  master  problem  is  solved  to  opti¬ 
mality  or  through  the  master  problem’s  global  upper  bound. 

Another  useful  technique  for  Algorithm  IE  is:  Do  not 
use  Benders  cuts  in  early  iterations.  Instead,  we  heuristically 
solve  Algorithm  2’s  set-covering  master  problem  to  hnd 
new  solutions  x  until  the  heuristic  fails.  Then,  we  switch  to 
the  full  master  problem  [Master(XT,  XY' ,  z,  e)-lb].  If  this 
problem  is  infeasible,  orifz  —  z  =  Zgf  —  z  ^  e,  the 
algorithm  halts.  Otherwise,  it  proceeds  using  the  full  master 
problem. 

7.  COMPUTATIONAL  EXPERIENCE 

7.1.  Test  Problems  and  Environment 

We  test  our  algorithms  on  a  set  of  directed  grid  networks 
of  different  size  and  with  randomly  generated  arc  attributes 
(Fig.  3): 

1.  There  is  one  source  node  s  and  one  sink  node  t. 

2.  There  are  m  X  n  “transshipment  nodes”  arranged  in  a 
grid  of  m  rows  and  n  columns. 
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TABLE  1.  Test  problem  statistics. 


Problem 

m  X  n 

a 

c  d  r  rg 

1 

10  X  10 

396 

10  10  5  20 

2 

30 

3 

40 

4 

50 

5 

12  X  8 

370 

25 

6 

8  X  12 

382 

7 

14  X  7 

370 

8 

7  X  14 

391 

9 

15  X  10 

611 

10 

10  X  15 

626 

11 

20  X  12 

1,018 

12 

12  X  20 

1,042 

13 

7X7 

188 

10  =  5  or  10  1  5 

14 

7X7 

10 

15 

8X8 

238 

5 

16 

8X8 

10 

17 

9X9 

312 

5 

18 

9X9 

10 

19 

12  X  12 

594 

5 

20 

12  X  12 

10 

Blank  table  cells  repeat  values  from  cells  above.  Problems  13-20  are 

k-most-vital- 

■arcs  problems  for  k  =  5 

or  k  =  10  and  with  artificial  delays 

of  =  5  1 

or  =  10. 

(d*  =  10 

is  “sufficiently  large;”  c/"’’  =  5  may 

not  be.)  m 

X  n.  Grid 

of  nodes  has  m  rows  and  n  columns;  a,  no. 

interdictahle 

arcs;  c,  arc 

costs  are 

integers  in  the  range  [1,  c];  d,  arc 

delays  d(.  are  integers  in  the  range  [  1 ,  d],  except  for  problems  13-20;  r,  arc 

interdiction 

resources 

are  integers 

in  the  range  [1,  r];  Tq,  total  inter- 

diction  resource  available. 

3.  There  is  a  0-length  arc  from  s  to  each  transshipment 
node  in  the  first  column,  and  there  is  a  0-length  arc  from 
each  transshipment  node  in  the  last  column  to  t.  None  of 
these  2m  arcs  may  he  interdicted. 

4.  An  arc  exists  from  each  node  in  row  r  and  column  c,  that 
is,  in  grid  position  (r,  c),  to  the  nodes  in  positions  (r 
+  1,  c),  (r  —  1,  c),  (r,  c  -f  1),  (r  -f  1,  c  -b  1),  and 
(r  —  l,c-l-  1)  provided  that  (i)  a  node  exists  in  the 
particular  position,  and  (ii)  these  are  not  vertical  arcs  in 
the  first  or  last  columns,  which  would  he  superfluous. 
All  these  arcs  are  interdictahle. 

5.  The  basic  data  for  each  network  are 

(a)  m  and  n  [so  that  there  are  a  =  (n  —  2)(5m  —  4) 


+  3m  —  2  interdictahle  arcs,  and  2m  noninter- 
dictahle  arcs]; 

(b)  Maximum  arc  length  c,  maximum  arc  delay  d,  and 
maximum  resource  r  required  to  interdict  an  arc; 
all  these  values  are  positive  integers; 

(c)  Kq,  the  total,  positive  integer,  interdiction  resource 
available. 

6.  The  randomly  generated,  integer  data  for  each  interdict- 
able  arc  k  are  c^,  d/^,  and  r^,  uniformly  distributed  on  [  1 , 
c],  [1,  d],  and  [1,  r],  respectively. 

Table  1  provides  summary  statistics  for  the  test  prob¬ 
lems. 

We  program  our  algorithms  in  C  using  the  CPLEX 
version  6.5  callable  library  [26]  for  exact  solution  of  master 
problems,  when  needed,  and  for  direct  solutions  of  the  MIP 
[MXSP-D].  Extensive  testing  indicates  that  default  solver 
options  are  best  except  that  “variable  selection  strategy”  is 
set  to  “branch  based  on  pseudoreduced  cost”  in  all  cases. 
Computation  is  performed  on  an  IBM  RS-6000  Model  595 
workstation  with  512  megabytes  of  RAM.  Run  times  shown 
are  averages  across  10  networks  of  identical  topology,  but 
with  different  random  arc  attributes. 

7.2.  Basic  Results 

Results  for  problems  1-4  (Table  2)  compare  solution 
methods  as  total  interdiction  resource  changes.  All  prob¬ 
lems  are  solved  to  optimality  here,  that  is,  e  =  0. 

Overall,  Algorithms  IE  and  2E  are  competitive  with  each 
other  and  are  the  fastest  of  the  four  procedures  by  a  wide 
margin.  We  would  also  like  to  point  out  that 

1.  Varying  arc  attributes,  while  holding  the  network  topol¬ 
ogy  and  algorithm  fixed,  can  lead  to  widely  varying 
solution  times  for  all  algorithms:  The  fastest  run  among 
the  10  instances  of  a  problem  may  be  20  times  faster  than 
the  slowest.  We  are  still  investigating  ways  to  reduce  run 
times  for  the  longer-running  problems. 

2.  All  algorithms  are  sensitive  to  total  interdiction  resource 
Tq.  Run  times  typically  increase  rapidly  as  Tq  increases 
from  a  small  value  but  then  start  decreasing  for  suffi¬ 
ciently  large  values,  beyond  those  displayed  here.  This 


TABLE  2.  Computational  results  for  a  network  with  100  =  10  X  10  transshipment  nodes  (a  =  396),  c  =  10,  d  =  10,  and  r  =  5;  e  =  0. 


Problem 

fo 

[MXSP-D] 

Algorithm  1 

Algorithm  IE 

Algorithm  2E 

T 

S 

T 

s 

N 

P 

T 

s 

N 

P 

T 

S 

N 

P 

1 

20 

60 

36 

219 

139 

53 

306 

3 

3 

21 

334 

4 

4 

22 

341 

2 

30 

651 

757 

(5) 

— 

— 

— 

26 

31 

34 

671 

39 

51 

37 

693 

3 

40 

(4) 

— 

(0) 

— 

— 

— 

135 

162 

52 

1101 

191 

277 

54 

1167 

4 

50 

(2) 

— 

(0) 

— 

— 

— 

(9) 

— 

— 

— 

1349 

1781 

77 

1656 

“[MXSP-D]”  gives  results  for  the  direct,  hranch-and-hound  solution  of  [MXSP-D].  Nos.  in  parentheses  are  the  no.  problems,  out  of  10,  solved  to 
optimality  in  under  3600  CPU  s.  “ — ”  indicates  “not  applicable”  because  at  least  one  of  the  10  instances  could  not  be  solved  in  the  allotted  time.  T,  Average 
run  time,  in  CPU  seconds,  for  10  problems;  S,  standard  deviation  of  T  in  CPU  seconds;  N,  average  number  of  iterations  for  the  algorithm;  P,  average 
number  of  constraints  in  master  problem  when  algorithm  terminates. 
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TABLE  3. 

Computational  results  for  networks  with  different 

row-to-column  ratios, 

with  Tq  = 

25,  c  =  10,  d 

=  10,  and 

r  =  5 

;  e  =  0. 

Problem 

m  X  n 

a 

[MXSP-D] 

Algorithm  IE 

Algorithm  2E 

T 

S 

T 

5 

N 

P 

T 

s 

N 

P 

5 

12  X  8 

370 

296 

369 

1 

1 

15 

186 

1 

1 

16 

186 

6 

8  X  12 

382 

286 

326 

72 

95 

40 

949 

71 

86 

40 

935 

7 

14  X  7 

370 

131 

139 

1 

1 

13 

126 

1 

1 

14 

127 

8 

7  X  14 

391 

298 

387 

222 

301 

54 

1668 

409 

515 

58 

1768 

9 

15  X  10 

611 

(8) 

— 

3 

3 

18 

305 

3 

3 

20 

311 

10 

10  X  15 

626 

(8) 

— 

407 

475 

54 

1886 

111 

965 

58 

2044 

11 

20  X  12 

1018 

(3) 

— 

11 

12 

21 

438 

1 

7 

22 

438 

12 

12  X  20 

1042 

(0) 

— 

(3) 

— 

— 

— 

(1) 

— 

— 

— 

The  total  no.  interdictable  arcs  is  a.  See  Table  2  for  other  definitions. 


makes  sense  since  increasing  interdiction  resource  al¬ 
lows  more  combinations  of  arcs  to  be  interdicted,  up  to 
a  point.  Then,  for  sufficiently  large  r^,  all  or  nearly  all 
arcs  can  be  interdicted  and  the  problem  becomes  easy. 

3.  We  find  that  branch  and  bound  does  not  solve  any  of  the 
problems  much  faster  even  if  it  identifies  an  optimal 
solution  immediately  and  simply  needs  to  prove  optimal¬ 
ity.  For  instance,  results  for  problems  3  and  4  do  not 
materially  change  if  an  optimal  solution  is  known  as  the 
branch-and-bound  procedure  begins,  and  solution  times 
improve  less  than  10%  for  problems  1  and  2.  Evidently, 
the  LP-based  bounds  improve  only  slowly  as  the  enu¬ 
meration  tree  expands. 

Table  3  displays  results  from  runs  that  explore  the  sen¬ 
sitivity  of  the  algorithms  to  a  network’s  row-to-column 
ratio.  Results  for  Algorithm  1  are  omitted  because,  as  in 
Table  1,  they  are  much  worse  than  for  Algorithm  IE  and 
even  [MXSP-D].  The  decomposition  algorithms  appear  to 
prefer  “tall  networks”  like  the  12  X  8  network  over  “long 
networks”  like  the  7  X  14  network.  This  tendency  may 
result  from  the  greater  number  of  paths  in  a  long  network 
and  the  potentially  greater  number  of  constraints  in  the 
corresponding  master  problems  and  because  there  is  a  pos¬ 
itive  correlation  between  the  number  of  potential  constraints 
and  the  actual  number  needed  to  generate  a  tight  master 
problem. 

We  next  explore  how  allowing  e  >  0  may  shorten  run 
times  for  Algorithms  IE  and  2E  and,  for  the  sake  of  com¬ 
parison,  for  direct  solutions  of  [MXSP-D].  Improved  run 
times  result  because  (i)  branch-and-bound  enumeration 
trees  can  be  trimmed  for  the  [MXSP-D]  MIP  and  for  Algo¬ 
rithm  IE’s  master  problem,  (h)  termination  tests  in  the 
decomposition  algorithms  are  more  easily  satisfied,  and  {Hi) 
the  SVIs  in  the  decomposition  algorithms  may  be  more 
aggressively  lifted  or  tightened  as  e-SVIs. 

We  repeat  the  computational  tests  on  five  of  the  most 
difficult  problems  from  Tables  2  and  3  while  allowing  a  5% 
optimality  gap.  (Optimality  gaps  were  described  previously 
in  absolute  terms.  Here,  an  allowable  gap  of  g  %  indicates 
that  100(z  —  z)/z  ^  g).  Results  are  displayed  in  Table  4. 
Indeed,  all  times  are  reduced  with  the  relaxed  optimality 


criterion,  and  even  branch  and  bound  becomes  more  com¬ 
petitive. 

Table  5  compares  several  algorithms  for  the  variant  of 
MXSP  in  which  interdiction  destroys  arcs,  making  them 
impassable.  The  cost  of  interdiction  is  fixed  to  one  unit  of 
resource  per  arc,  so  we  are  actually  solving  the  k-most-vital- 
arcs  problem,  for  k  =  5  and  k  =  10,  in  four  different 
network  topologies.  [MXSP-D]  and  Algorithm  1  use  artifi¬ 
cial  delays  of  =  5  and  =  10.  However,  =  5  is 
often  too  small  and  yields  invalid  solutions,  while  <7^  =  10 
is  sufficiently  large  but  results  in  long  run  times. 

Both  branch  and  bound  and  Algorithm  1  perform  poorly; 
Algorithm  2  is  the  fastest  by  a  substantial  margin.  Results 
for  Algorithm  IE  are  omitted  because  that  algorithm  is 
uniformly  slower  than  is  Algorithm  2  here.  (We  can  view 
Algorithm  IE  as  Algorithm  2  with  Benders  cuts  added  in 
the  master  problem.  But,  these  cuts  are  weak  and  uninfor¬ 
mative  when  all  delays  are  identical  and/or  large,  and  thus 
the  cuts  only  serve  to  hinder  solution  of  Algorithm  2’s 
master  problem.)  Results  for  Algorithm  2E  are  omitted 
because,  when  is  large,  lifting  and  local  search  are 
ineffective  for  that  algorithm’s  master  problem. 

As  a  side  note,  it  is  interesting  to  see  that  “plain”  Benders 
decomposition,  Algorithm  1,  is  faster  than  is  branch  and 


TABLE  4.  Computational  tests  on  the  hardest  problems  from  Tables  2 
and  3,  with  a  5%  optimality  gap  allowed. 


Problem 

[MXSP-D] 

Algorithm  IE 

Algorithm  2E 

T 

(5%) 

T 

(opt) 

T 

(5%) 

T 

(opt) 

T 

(5%) 

T 

(opt) 

3 

(9) 

(4) 

104 

135 

lA 

191 

4 

1378 

(2) 

604 

(9) 

799 

1349 

8 

27 

298 

77 

222 

201 

409 

10 

301 

(8) 

113 

407 

256 

2044 

12 

(8) 

(0) 

(8) 

(3) 

(3) 

(1) 

Times  ‘T  (5%)”  are  the  results  in  CPU  seconds  averaged  over  the  10 
test  problems.  For  comparison,  “T  (opt)”  gives  the  average  solution  times 
in  seconds,  taken  from  Tables  2  and  3,  when  the  same  problems  are  solved 
to  optimality.  As  before,  run  times  are  limited  to  3600  seconds,  and  the  nos. 
in  parentheses  indicate  the  no.  problems  that  can  be  solved  under  that  limit. 
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TABLE  5.  Results  for  the  /c-most-vital-arcs  problems. 


Problem 

k 

m  X  n 

a 

OK 

d*^  = 

T 

[MXSP-D] 

5  =  10 

T 

Algorithm  1 

d*  =  5  d^  =  10 

T  T 

Algorithm  2 

T 

13 

5 

7X7 

188 

8 

6 

23 

1 

5 

0.3 

14 

10 

7X7 

188 

2 

71 

1551 

66 

(7) 

7.1 

15 

5 

8X8 

238 

10 

15 

84 

2 

11 

0.4 

16 

10 

8X8 

238 

7 

161 

(2) 

222 

(0) 

10.0 

17 

5 

9X9 

312 

4 

24 

162 

5 

26 

0.6 

18 

10 

9X9 

312 

10 

644 

(0) 

977 

(0) 

44.7 

19 

5 

12  X  12 

594 

6 

93 

811 

8 

68 

2.1 

20 

10 

12  X  12 

594 

(6) 

(0) 

(5) 

(0) 

446.9 

Neither  branch  and  bound  nor  Algorithm  1  solve  all  problems  correctly  when  is  too  small,  that  is,  when  =  5.  All  problems  can,  theoretically, 
be  solved  correctly  by  those  techniques  when  d^  =  10,  but  not  necessarily  within  the  3600-second  time  limit;  nos.  in  parentheses  show  the  no.  solved 
under  that  limit.  Algorithm  2  does  not  depend  on  the  artificial  delay  d^  and  is  the  fastest  of  the  three  techniques  tested.  The  value  marked  by  was 
determined  by  increasing  the  time  limit  for  [MXSP-D]  to  10,000  seconds,  k.  Total  no.  arcs  the  interdictor  may  interdict;  d^,  artificial  delay;  T,  average 
CPU  time  to  solve  10  problem  instances;  OK,  no.  problems  that  solve  conectly  when  d*  =  5. 


bound  on  many  of  these  problems.  The  Benders  master 
problem  is  no  stronger  than  is  [MXSP-D],  so  this  fact  must 
result  from  quick  solutions  of  the  shortest-path  subprob¬ 
lems. 

7.3.  SVIs  to  Speed  Direct  Solutions 

This  section  explores  the  use  of  SVIs  to  speed  the  direct 
solution  of  the  MIP  [MXSP-D]  via  branch  and  bound:  We 
heuristically  generate  a  set  of  SVIs,  add  them  to  the  MIP, 
and  then  launch  the  branch-and-bound  code.  Integer  cutting 
planes  have  been  used  in  this  fashion  to  help  solve  general 
MIPs  by  branch  and  bound,  starting  with  Dantzig  et  al.  [16], 
and  continuing  to  today’s  commercial  solvers.  This  use  is 
not  as  sophisticated  as  “branch  and  cut”  where  cutting 
planes  are  integrated  into  the  branch-and-bound  procedure 
(e.g.,  Wolsey  [44]  pp.  157-160),  but  success  with  the  sim¬ 


pler  technique  should  bode  well  for  more  sophisticated 
applications.  Indeed,  the  topic  of  SVIs  warrants  a  full  re¬ 
search  paper  on  its  own;  we  only  intend  to  illustrate  its 
potential. 

To  generate  the  SVIs,  we  run  Algorithm  2  and  heuristi¬ 
cally  solve  the  set-covering  master  problem  until  the 
heuristic  fails.  Each  set-covering  solution,  together  with 
Local_Search,  yields  multiple  Type-I  SVIs.  These  are 
tightened,  as  appropriate,  using  information  about  the  in¬ 
cumbent  solution’s  value  and  corresponding  Benders  cut 
coefficients  (which  are  generated  and  saved,  but  used  only 
for  this  purpose). 

Table  6  displays  results  for  [MXSP-D]  with  and  without 
SVIs  and,  for  comparison,  results  for  Algorithm  2E.  Dra¬ 
matic  improvements  are  obtained  using  SVIs  in  conjunction 
with  the  MIP.  In  fact,  branch  and  bound  plus  SVIs  performs 
better  than  does  Algorithm  2E  in  two  instances.  Improve- 


TABLE  6.  Computational  results  for  [MXSP-D]  with  SVIs  added. 


Problem 

[MXSP-D] 

[MXSP-D]  +  SVIs 

Algorithm  2E 

cons 

vars 

T 

S 

enum 

SVIs 

T 

S 

enum 

T 

S 

1 

418 

518 

60 

36 

3992 

367 

12 

12 

66 

4 

4 

2 

651 

757 

47,417 

683 

83 

100 

768 

39 

51 

3 

(4) 

— 

>159K 

1158 

584 

890 

3470 

191 

211 

4 

(2) 

— 

>212K 

1788 

(8) 

— 

>5221 

1349 

1781 

5 

396 

492 

296 

369 

22,622 

254 

8 

5 

24 

1 

1 

6 

400 

496 

286 

326 

19,599 

1304 

87 

40 

318 

57 

69 

7 

396 

498 

131 

139 

9822 

156 

2 

2 

2 

1 

1 

8 

407 

505 

298 

387 

19,911 

1504 

314 

234 

2110 

409 

515 

9 

643 

793 

(8) 

— 

>87K 

340 

24 

12 

65 

3 

3 

10 

648 

798 

(8) 

— 

>66K 

1815 

922 

799 

6957 

121 

965 

11 

991 

1191 

(3) 

— 

>86K 

438 

92 

93 

569 

1 

7 

12 

1022 

1238 

(0) 

— 

>97K 

3456 

(2) 

— 

>4755 

(1) 

— 

The  same  10  instances  of  each  problem  that  generate  the  results  in  Tables  2  and  3  are  used  here.  Results  for  [MXSP-D]  and  Algorithm  2E  are  provided 
for  comparison.  T,  average  CPU  time  to  solve  10  problem  instances;  S,  standard  deviation  of  T;  cons,  no.  constraints  in  [MXSP-D];  var,  no.  variables  in 
[MXSP-D];  enum,  nodes  in  the  branch-and-bound  enumeration  tree;  SVIs,  no.  SVIs  (new  constraints)  added  to  [MXSP-D]. 
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merits  are  less  dramatic  when  the  number  of  SVIs  becomes 
large,  which  occurs  in  the  longer  networks. 

There  is  a  clear  trade-off  between  the  reduced  enumer¬ 
ation  achieved  with  SVIs  and  increased  solution  times  for 
the  LP  relaxations  of  the  resulting,  larger  MIPs:  Compare 
the  huge  reduction  in  the  size  of  branch-and-bound  trees  to 
the  lesser  improvement  in  run  times,  especially  with  the 
longer  networks.  Further  research  is  warranted. 

8.  CONCLUSIONS 

This  paper  has  defined  a  shortest-path  network-interdic¬ 
tion  problem,  MXSP,  on  a  directed  network.  The  objective 
of  an  “interdictor”  is  to  interdict  (attack)  network  arcs,  using 
limited  resources,  in  order  to  maximize  the  length  of  a 
shortest  path  between  two  specified  nodes,  s  and  t.  Inter¬ 
diction  of  an  arc  increases  its  effective  length  or  destroys  the 
arc,  making  it  impassable.  The  ultimate  purpose  of  the 
interdiction  is  to  delay  a  “network  user”  from  traveling 
between  s  and  t. 

We  have  formulated  MXSP  as  a  standard  MIP,  but 
develop  special  decomposition  algorithms  that  solve  test 
problems  much  more  quickly  than  does  LP-based  branch 
and  bound  applied  to  the  MIP.  Straightforward  Benders 
decomposition  performs  poorly,  but  special  techniques,  in¬ 
cluding  “supervalid  inequalities”  (SVIs)  for  the  master 
problem,  improve  efficiency  significantly.  A  “covering  de¬ 
composition,”  which  uses  a  special  set-covering  master 
problem,  is  particularly  useful  for  problems  in  which  inter¬ 
diction  completely  destroys  arcs  or  adds  large  delays. 

An  SVI  generalizes  the  concepts  of  valid  inequality  and 
the  integer  cutting  plane  by  allowing  feasible  and  even 
optimal  solutions  to  be  eliminated.  We  have  also  added 
SVIs  to  the  MXSP  MIP,  just  as  valid  inequalities  might  be 
added,  and  have  demonstrated  substantial  speed-ups  in 
branch-and-bound  solutions.  It  will  be  interesting  to  inves¬ 
tigate  the  use  of  SVIs  for  solving  other  MIPs. 

Our  decomposition  techniques,  especially  Algorithm  2 
and  its  variants,  can  be  generalized  to  other  network-inter- 
diction  problems  and  to  “system  interdiction  problems.”  For 
instance,  we  may  wish  to  disrupt  a  segment  of  an  adver¬ 
sary’s  economy  by  attacking  key  components  of  that  econ¬ 
omy,  for  example,  power  generators  and  weapons  produc¬ 
tion  facilities.  We  simply  require  that  (i)  the  interdictor’ s 
choices  be  discrete  and  resource-constrained,  (;/)  interdic¬ 
tions  disrupt  system  activities  in  a  well-defined  manner,  and 
(Hi)  given  a  specific  set  of  interdictions,  it  is  possible  to 
determine  an  optimal  response  by  the  system  user. 

We  are  already  applying  these  generalizations  to  a  tri¬ 
level  “system-defense  problem,”  in  particular,  the  problem 
of  hardening  a  road  network  against  attack.  In  this  problem, 
the  network  user  has  limited  resources  to  harden  (make 
invulnerable)  arcs  in  his/her  network  against  potential  in¬ 
terdiction.  The  interdictor  observes  which  components  of 
his/her  adversary’s  network  have  been  hardened  and  solves 
a  shortest-path  interdiction  problem  to  determine  the  best 
interdiction  plan.  The  network  user  responds  with  a  new 


hardening  plan,  and  the  decomposition  proceeds  as  de¬ 
scribed  in  this  paper.  In  essence,  the  network  user  interdicts 
the  interdictor.  Our  solution  approach  uses  a  nested  decom¬ 
position  scheme.  We  are  also  pursuing  issues  of  uncertainty 
in  interdiction. 

Acknowledgments 

The  authors  thank  Gerald  Brown,  Robert  Dell,  Karla 
Hoffman,  Alexandra  Newman,  Javier  Salmerdn,  Alan 
Washburn,  and  two  anonymous  referees  for  numerous  sug¬ 
gestions  and  edits  that  have  improved  this  paper. 


REFERENCES 

[1]  R.K.  Ahuja,  T.L.  Magnanti,  and  J.B.  Orlin,  Network  Flows, 
Prentice-Hall,  Englewood  Cliffs,  NJ,  1993. 

[2]  G.  Anandalingam  and  V.  Aprey,  Multi-level  programming 
and  conflict  resolution,  Eur  J  Oper  Res  51  (1991),  233-247. 

[3]  A.  Atamturk,  G.L.  Nemhauser,  and  M.W.P.  Savelsbergh, 
Conflict  graphs  in  solving  integer  programming  problems, 
Eur  J  Oper  Res  121  (2000),  40-55. 

[4]  E.  Balas  and  E.  Zemel,  Eacets  of  the  knapsack  polytope 
from  minimal  covers,  SIAM  J  Appl  Math  34  (1978),  119- 
148. 

[5]  M.O.  Ball,  B.L.  Golden,  and  R.V.  Vohra,  Binding  the  most 
vital  arcs  in  a  network,  Oper  Res  Lett  8  (1989),  73-76. 

[6]  J.E.  Bard  and  J.T.  Moore,  A  branch  and  bound  algorithm  for 
the  bilevel  programming  problem,  SIAM  J  Sci  Stat  Comput 
11  (1990),  281-292. 

[7]  J.E.  Bard  and  J.T.  Moore,  An  algorithm  for  the  discrete 
bilevel  programming  problem.  Naval  Res  Log  39  (1992), 
419-435. 

[8]  J.E.  Beasley,  A  Lagrangian  heuristic  for  set-covering  prob¬ 
lems,  Naval  Res  Log  37  (1990),  151-164. 

[9]  O.  Ben-Ayed,  Bilevel  linear  programming,  Comput  Oper 
Res  20  (1993),  485-501. 

[10]  J.E.  Benders,  Pardoning  procedures  for  solving  mixed  inte¬ 
ger  variables  programming  problems,  Num  Math  4  (1962), 
238-252. 

[11]  T.H.  Byers  and  M.S.  Waterman,  Determining  all  optimal 
and  near-optimal  solutions  when  solving  shortest  path  prob¬ 
lems  by  dynamic  programming,  Oper  Res  32  (1984),  1381- 
1384. 

[12]  A.  Caprara,  M.  Fischetti,  and  P.  Toth,  A  heuristic  algorithm 
for  the  set  covering  problem.  Integer  programming  and 
combinatorial  optimization.  Lecture  Notes  on  Computer 
Science  1084,  W.H.  Cunningham,  S.T.  McCormick,  and  M. 
Queyranne  (Editors),  Springer- Verlag,  Berlin,  1996,  pp. 
72-81. 

[13]  H.W.  Corely  and  D.Y.  Shaw,  Most  vital  links  and  nodes  in 
weighted  networks,  Oper  Res  Lett  1  (1982),  157-160. 

[14]  K.J.  Cormican,  Computational  methods  for  deterministic 
and  stochastic  network  interdiction  problems.  Masters  The¬ 
sis,  Operations  Research  Department,  Naval  Postgraduate 
School,  Monterey,  CA,  1995. 


110  NETWORKS— 2002 


[15]  KJ.  Cormican,  D.P.  Morton,  and  R.K.  Wood,  Stochastic 
network  interdiction,  Oper  Res  46  (1998),  184-197. 

[16]  G.B.  Dantzig,  D.R.  Fulkerson,  and  S.M.  Johnson,  Solution 
of  a  large  scale  traveling  salesman  problem,  Oper  Res  2 
(1954),  393-410. 

[17]  J.E.  Falk  and  K.R.  Floffman,  A  successive  underestimation 
method  for  concave  minimization  problems.  Math  Oper  Res 
1  (1976),  251-259. 

[18]  D.R.  Fulkerson  and  G.C.  Harding,  Maximizing  the  mini¬ 
mum  source-sink  path  subject  to  a  budget  constraint.  Math 
Program  13  (1977),  116-118. 

[19]  R.S.  Garfinkel  and  G.L.  Nemhauser,  Integer  programming, 
Wiley,  New  York,  1972. 

[20]  A.M.  Geoffrion  and  G.W.  Graves,  Multicommodity  distri¬ 
bution  system  design  by  Benders  decomposition,  Mgmt  Sci 
20  (1974),  822-844. 

[21]  P.M.  Ghare,  D.C.  Montgomery,  and  T.M.  Turner,  Optimal 
interdiction  policy  for  a  flow  network.  Naval  Res  Log  Q  18 
(1971),  37-45. 

[22]  B.L.  Golden,  A  problem  in  network  interdiction.  Naval  Res 
Log  Q  25  (1978),  711-713. 

[23]  M.  Grbtschel,  C.L.  Monma,  and  M.  Stoer,  Computational 
results  with  a  cutting  plane  algorithm  for  designing  com¬ 
munication  networks  with  low-connectivity  constraints, 
Oper  Res  40  (1992),  309-330. 

[24]  P.  Hansen,  B.  Jaumard,  and  G.  Savard,  New  branch-and- 
bound  rules  for  linear  bi-level  programming,  SIAM  J  Sci 
StatComput  13  (1992),  1194-1217. 

[25]  J.N.  Hooker,  Logic-based  methods  for  optimization.  Prin¬ 
ciples  and  practice  of  constraint  programming.  Lecture 
Notes  in  Computer  Science  874,  A.  Boming  (Editor), 
Springer-Verlag,  Berlin,  1994,  pp.  336-349. 

[26]  ILOG  1999,  ILOG  CPLEX  6.5,  Reference  Manual,  ILOG, 
S.A.,  France. 

[27]  E.  Israeli,  System  interdiction  and  defense,  Ph.D.  Disserta¬ 
tion,  Operations  Research  Department,  Naval  Postgraduate 
School,  Monterey,  CA,  1999. 

[28]  J.J.  Judice  and  A.M.  Faustino,  A  sequential  LCP  method  for 
bilevel  linear  programming,  Ann  Oper  Res  34  (1992),  89- 
106. 

[29]  N.  Katoh,  T.  Ibaraki,  and  H.  Mine,  An  efficient  algorithm 


for  the  k  shortest  simple  paths.  Networks  12  (1982),  411- 
427. 

[30]  K.  Malik,  A.K.  Mittal,  and  S.K.  Gupta,  The  k  most  vital  arcs 
in  the  shortest  path  problem,  Oper  Res  Lett  8  (1989), 
223-227. 

[31]  A.W.  McMasters  and  T.M.  Mustin,  Optimal  interdiction  of 
a  supply  network.  Naval  Res  Log  Q  17  (1970),  261-268. 

[32]  D.  Medhi,  A  unified  approach  to  network  survivability  for 
teletraffic  networks:  Models,  algorithms  and  analysis,  IEEE 
Trans  Commun  42  (1994),  534-548. 

[33]  J.T.  Moore  and  J.E.  Bard,  The  mixed  integer  linear  bilevel 
programming  problem,  Oper  Res  38  (1990),  911-921. 

[34]  G.L.  Nemhauser  and  L.A.  Wolsey,  Integer  and  combinato¬ 
rial  optimization,  Wiley,  New  York,  1988. 

[35]  H.  Onal,  A  modified  simplex  approach  for  solving  bi-level 
programming  problems,  Eur  J  Oper  Res  67  (1993),  126- 
135. 

[36]  M.  Padberg,  A  note  on  zero-one  programming,  Oper  Res  23 
(1975),  833-837. 

[37]  M.  Simaan  and  J.B.  Cruz,  On  the  Stackelberg  strategy  in 
nonzero-sum  games,  J  Optim  Theory  Appl  11  (1973),  533- 
555. 

[38]  H.A.  Taha,  Integer  programming.  Academic  Press,  New 
York,  1975. 

[39]  H.  Vaish  and  C.M.  Shetty,  A  cutting  plane  algorithm  for  the 
bilinear  programming  problem.  Naval  Res  Log  Q  24  (1977), 
83-94. 

[40]  L.  Vicente,  G.  Savard,  and  J.  Judice,  Discrete  linear  bi-level 
programming  problem,  J  Optim  Theory  Appl  89  (1996), 
597-614. 

[41]  A.  Washburn  and  K.  Wood,  Two-person  zero-sum  games 
for  network  interdiction,  Oper  Res  43  (1994),  243-251. 

[42]  U.P.  Wen  and  Y.H.  Yang,  Algorithms  for  solving  the  mixed 
integer  two-level  linear  programming  problem,  Comput 
Oper  Res  17  (1990),  133-142. 

[43]  P.S.  Whiteman,  Improving  single  strike  effectiveness  for 
network  interdiction,  Mil  Oper  Res  4  (1999),  15-30. 

[44]  L.A.  Wolsey,  Integer  programming,  Wiley,  New  York, 
1998. 

[45]  R.K.  Wood,  Deterministic  network  interdiction.  Math  Com¬ 
put  Mod  17  (1993),  1-18. 


NETWORKS— 2002  1 1 1 


